TDV Amazon S3 Adapter

Amazon S3 is a file system in the cloud. It is a storage system that provides shared access to file data.

This topic describes the configuration of this Cloud File System based data source. TDV supports the following Cloud based File Systems:

Amazon S3
Microsoft Azure Data Lake Storage
Local File Storage
Google Cloud Storage

Refer to the corresponding Adapter guides for details on how to configure those.

The File formats supported for Amazon S3 adapter are:

Delimited file format
Parquet file format

Note: The delimited file format is a flat file format while the Parquet files can store data in a hierarchical format also. If the “Infer Schema” option is selected for the data source, TDV will infer the schema and datatypes of each column based on the data in the file.

In this chapter, the following topics are discussed:

Connecting to Amazon S3 Data Source

Data Type Mapping

Supported Functions